Fukuoka Prefecture
Facial recognition technology coming into wider use in Japan
Services using facial recognition technology are expanding in Japan, allowing, for example, touchless or ticketless entry through train station gates and payments at shops without the need to take out a wallet or a credit card. Expectations are growing that the evolution of artificial intelligence will improve accuracy of facial recognition systems and help reduce fraud. Meanwhile, concerns about privacy violations persist, making thorough user information management essential. Trial Holdings, which runs discount stores and other operations, has introduced a payment service using NEC's facial recognition technology at 15 stores in Tokyo and Fukuoka Prefecture. Advance registration allows customers to shop simply by scanning goods at the self-checkout counter without using cash or smartphone payment services.
Language Model Tokenizers Introduce Unfairness Between Languages
Recent language models have shown impressive multilingual performance, even when not explicitly trained for it. Despite this, there are concerns about the quality of their outputs across different languages. In this paper, we show how disparity in the treatment of different languages arises at the tokenization stage, well before a model is even invoked. The same text translated into different languages can have drastically different tok-enization lengths, with differences up to 15 times in some cases. These disparities persist even for tokenizers that are intentionally trained for multilingual support.